Improved Gaussian Mixture Density

نویسنده

  • Dirk Ormoneit
چکیده

We compare two regularization methods which can be used to improve the generalization capabilities of Gaussian mixture density estimates. The rst method consists of deening a Bayesian prior distribution on the parameter space. We derive EM (Expectation Maximization) update rules which maximize the a posterior parameter probability in contrast to the usual EM rules for Gaussian mixtures which maximize the likelihood function. In the second approach we apply ensemble averaging to density estimation. This includes Breiman's "bagging", which has recently been found to produce impressive results for classiication networks. To our knowledge this is the rst time that ensemble averaging is applied to improve density estimation.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Improved Bearings-Only Multi-Target Tracking with GM-PHD Filtering

In this paper, an improved nonlinear Gaussian mixture probability hypothesis density (GM-PHD) filter is proposed to address bearings-only measurements in multi-target tracking. The proposed method, called the Gaussian mixture measurements-probability hypothesis density (GMM-PHD) filter, not only approximates the posterior intensity using a Gaussian mixture, but also models the likelihood functi...

متن کامل

Improved Gaussian Mixture Model in Video Motion Detection

As the classical Gaussian mixture model has some problems of not considering it self’s matching degree of Gaussian density functions, model updating and the background in real video motion detection, made improvements on the three aspects. Optimized Gaussian mixture model’s overall architecture and proposed an improved algorithm according to the analysis of the definition and disadvantages of c...

متن کامل

Image Texture Classification Based on Finite Gaussian Mixture Models

A novel image texture classification method based on finite Gaussian mixture models of sub-band coefficients is proposed in this paper. In the method, an image texture is first decomposed into several sub-bands, then the marginal density distribution of coefficients in each sub-band is approximated by Gaussian mixtures. The Gaussian component parameters are estimated by an “EM+MML” algorithm wh...

متن کامل

Fully Nonparametric Probability Density Function Estimation with Finite Gaussian Mixture Models

Flexible and reliable probability density estimation is fundamental in unsupervised learning and classification. Finite Gaussian mixture models are commonly used to serve this purpose. However, they fail to estimate unknown probability density functions when used for nonparametric probability density estimation, as severe numerical difficulties may occur when the number of components increases....

متن کامل

Fast and Extensible Online Multivariate Kernel Density Estimation

In this paper we present xokde++, a state-of-the-art online kernel density estimation approach that maintains Gaussian mixture models input data streams. The approach follows state-of-the-art work on online density estimation, but was redesigned with computational efficiency, numerical robustness, and extensibility in mind. Our approach produces comparable or better results than the current sta...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1995